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This  paper  describes  a  multi-vehicle  motion  control  framework  for  time-critical 
cooperative  missions  and  evaluates  its  performance  by  considering  two  case  stud¬ 
ies:  a  simultaneous  arrival  mission  scenario  and  a  sequential  auto-landing  of  a  fleet 
of  UAVs.  In  the  adopted  setup,  the  UAVs  are  assigned  nominal  spatial  paths 
and  speed  profiles  along  those,  and  the  vehicles  are  then  tasked  to  execute  co¬ 
operative  path  following,  rather  than  “open-loop”  trajectory-tracking  maneuvers. 
This  cooperative  strategy  yields  robust  behavior  against  external  disturbances  by 
allowing  the  UAVs  to  negotiate  their  speeds  along  the  paths  in  response  to  coordi¬ 
nation  information  exchanged  over  the  supporting  communications  network.  The 
approach  applies  to  teams  of  heterogeneous  vehicles  and  does  not  necessarily  lead 
to  swarming  behavior. 


I.  Introduction 

Unmanned  Aerial  Vehicles  (UAVs)  are  ubiquitous  in  military  reconnaissance  and 
strike  operations,  border  patrol  missions,  forest  fire  detection,  police  surveillance,  and 
recovery  operations.  In  simple  applications,  a  single  autonomous  vehicle  can  be  managed 
by  a  crew  using  a  ground  station  provided  by  the  vehicle  manufacturer.  The  execution  of 
more  challenging  missions,  however,  requires  the  use  of  multiple  vehicles  working  in  coop¬ 
eration  to  achieve  a  common  objective.  Representative  examples  of  cooperative  mission 

*Professor,  Department  of  Mechanical  &  Astronautical  Engineering,  kaminer@nps.edu. 

RhD  Candidate,  Department  of  Aerospace  Engineering,  xargay@illinois.edu. 

+PhD  Student,  Department  of  Mechanical  Science  &  Engineering,  cichell2@illinois.edu. 
^Professor,  Department  of  Mechanical  Science  &  Engineering,  nhovakim@illinois.edu. 

^ Associate  Professor,  Laboratory  of  Robotics  and  Systems  in  Engineering  and  Science  (LARSyS), 
antonio@isr . ist .utl . pt. 

II Assistant  Professor,  Laboratory  of  Robotics  and  Systems  in  Engineering  and  Science  (LARSyS), 

pedro@isr . ist .utl.pt. 

“Research  Associate  Professor,  Department  of  Mechanical  &  Astronautical  Engineering, 

vldobr@nps . edu. 

u Research  Fellow,  Department  of  Intelligent  Hydraulics  and  Automation,  reza.ghabcheloo@tut.fi. 


627 


scenarios  are  sequential  auto-landing  and  coordinated  ground  target  suppression  for  mul¬ 
tiple  UAVs.  In  both  cases,  only  relative  (rather  than  absolute )  temporal  constraints  are 
given  a  priori,  and  the  vehicles  must  execute  maneuvers  in  close  proximity  to  each  other. 
Also,  the  information  exchanged  among  vehicles  may  be  restricted  for  security  reasons 
or  because  of  tight  bandwidth  limitations.  Moreover,  the  topology  of  the  inter-vehicle 
communications  network  supporting  the  cooperative  mission  may  change  over  time.  This 
paper  considers  cooperative  motion  control  strategies  that  can  yield  robust  performance 
in  the  presence  of  time-varying  communications  networks  arising  from  temporary  loss  of 
communications  links  and  switching  communications  topologies. 

The  range  of  relevant,  related  topics  addressed  in  literature  includes  parallel  comput¬ 
ing  [1],  synchronization  of  oscillators  [2],  study  of  collective  behavior  and  flocking  [3], 
multi-system  consensus  mechanisms  [4],  multi- vehicle  system  formations  [5-8],  coordi¬ 
nated  motion  control  [9-11],  cooperative  path  and  trajectory  planning  [12-16],  asyn¬ 
chronous  protocols  [17],  dynamic  graphs  [18],  stochastic  graphs  [18-20],  and  graph-related 
theory  [21,22].  Especially  relevant  are  the  applications  of  the  theory  developed  in  the  area 
of  multi- vehicle  formation  control:  spacecraft  formation  flying  [23],  UAV  control  [24,25], 
coordinated  control  of  land  robots  [9],  and  control  of  multiple  autonomous  underwater 
vehicles  and  surface  vessels  [26-35].  In  spite  of  significant  progress  in  the  field,  much  work 
remains  to  be  done  to  develop  strategies  capable  of  yielding  robust  performance  of  a  fleet 
of  vehicles  in  the  presence  of  complex  vehicle  dynamics,  communications  constraints,  and 
partial  vehicle  failures. 

In  [36],  we  addressed  the  problem  of  steering  a  fleet  of  UAVs  along  desired  paths 
while  meeting  stringent  spatial  and  temporal  constraints.  The  vehicles  are  assigned  nom¬ 
inal  paths  and  speed  profiles  along  them,  obtained  form  the  solution  of  an  appropriately 
formulated  optimization  problem  for  the  given  mission.  The  paths  are  appropriately  pa¬ 
rameterized,  and  the  vehicles  are  requested  to  execute  cooperative  path  following,  rather 
than  “open-loop”  trajectory-tracking  maneuvers.  The  strategies  derived  yield  robust 
performance  in  the  face  of  external  disturbances  by  allowing  the  vehicles  to  negotiate 
their  speeds  along  the  paths  in  response  to  information  exchanged  over  the  supporting 
communications  network.  The  proposed  solution  has  a  multiloop  control  structure  in 
which  an  inner-loop  controller  stabilizes  the  vehicle  dynamics,  while  a  guidance  outer- 
loop  controller  is  designed  to  control  the  vehicle  kinematics,  providing  path-following  and 
time-coordination  capabilities.  This  inner-outer  loop  approach  simplifies  the  design  pro¬ 
cess  and  affords  the  designer  a  systematic  approach  to  seamlessly  tailor  the  algorithms  for 
a  very  general  class  of  vehicles  that  come  equipped  with  inner-loop  commercial  autopi¬ 
lots.  The  reader  is  referred  to  [37-42]  and  the  references  therein  for  a  general  perspective 
of  key  ideas  and  concepts  that  are  at  the  root  of  this  cooperative  approach. 

In  the  present  paper,  we  present  simulation  results  of  two  multi-vehicle  time-critical 
missions  that  exploit  the  cooperative  control  framework  developed  in  [36].  In  the  first 
mission,  three  UAVs  must  follow  spatially-deconflicted  paths  and  arrive  at  predefined 
locations  at  the  same  time.  The  second  mission  considers  the  case  of  sequential  auto¬ 
landing,  in  which  three  UAVs  must  arrive  at  the  glide  path  separated  by  prespecified 
safe-guarding  time-intervals  and  maintain  this  separation  as  they  fly  along  the  glides- 
lope.  In  this  second  scenario,  the  cooperative  control  algorithm  is  critical  to  provide 
UAV  trajectory  deconfliction,  as  well  as  to  ensure  that  the  UAVs  follow  the  glide  path  at 
a  desired  approach  speed  while  maintaining  the  safe-guarding  separation. 

The  paper  is  organized  as  follows.  Section  II  formulates  the  time-critical  cooperative 
path- following  problem,  describes  the  kinematics  of  the  systems  of  interest,  and  introduces 
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a  set  of  assumptions  on  the  supporting  communications  network.  Section  III  presents  a 
path-following  control  algorithm  for  UAVs  in  3D  space.  Section  IV  derives  a  strategy  for 
time-critical  cooperative  path  following  of  multiple  UAVs  that  relies  on  the  adjustment  of 
the  speed  profile  of  each  vehicle.  This  section  also  discusses  the  convergence  properties  of 
the  overall  control  architecture.  Section  V  presents  simulation  results  that  demonstrate 
the  effectiveness  of  the  algorithms.  Finally,  Section  VI  summarizes  the  key  results  and 
contains  the  main  conclusions. 


Notation 

The  following  notation  is  used  throughout  the  paper.  {u}f  is  used  to  denote  the 
vector  v  resolved  in  frame  F;  {c}f  represents  the  vector  e  resolved  in  frame  F\  u>fi/F2 
denotes  the  angular  velocity  of  frame  FI  with  respect  to  frame  F2\  the  rotation  matrix 
from  frame  T\  to  frame  F2  is  represented  by  Rp f;  v]p  indicates  that  the  time-derivative 
of  vector  v  is  taken  in  frame  F.  Unless  otherwise  noted,  ||-||  is  used  for  both  the  2-norm  of  a 
vector  and  the  induced  2-norm  of  a  matrix.  Finally,  S0(3)  denotes  the  Special  Orthogonal 
group  of  all  rotations  about  the  origin  of  three-dimensional  Euclidean  space  R3,  while 
so (3)  represents  the  set  of  3  x  3  skew-symmetric  matrices  over  R. 

II.  Time-Critical  Cooperative  Path  Following:  Problem  Formulation 

This  section  provides  a  brief  formulation  of  the  problem  of  time-critical  cooperative 
path-following  control  for  multiple  UAVs  in  3D  space,  in  which  a  fleet  of  UAVs  is  tasked 
to  converge  to  and  follow  a  set  of  desired  feasible  paths  so  as  to  meet  spatial  and  temporal 
constraints.  The  section  also  introduces  the  set  of  assumptions  and  constraints  on  the 
supporting  inter-vehicle  communications  network. 

The  problem  of  cooperative  trajectory  generation  is  not  addressed  in  this  paper.  In 
fact,  it  is  assumed  that  a  set  of  desired  3D  time  trajectories  Pd,i(td)  ■  R  — >■  R3,  conveniently 
parameterized  by  a  single  time- variable  td  G  [0,  td],  are  known  for  all  the  n  UAVs  involved 
in  the  cooperative  mission.  The  variable  td  represents  a  desired  mission  time  (distinct 
from  the  actual  mission  time  that  evolves  as  the  mission  unfolds),  with  t*d  being  the  de¬ 
sired  mission  duration.  For  a  given  td,  Pdfitd)  defines  the  desired  position  of  the  All  UAV 
td  seconds  after  the  initiation  of  the  cooperative  mission.  These  time  trajectories  can  be 
reparameterized  in  terms  of  path  length  to  obtain  spatial  paths  Pd.iijzA  :  R  — >  R3  -with 
no  temporal  specifications-  and  the  corresponding  desired  speed  profiles  Vd,i(td)  '■  R  — >  R. 
For  convenience,  each  spatial  path  is  parameterized  by  its  path  length  G  [0 ,£fi\,  where 
£fi  denotes  the  total  length  of  the  Ah  path,  whereas  the  desired  speed  profiles  are  pa¬ 
rameterized  by  the  desired  mission  time  td .  It  is  assumed  that  both  the  paths  and  the 
speed  profiles  satisfy  collision-avoidance  constraints  as  well  as  appropriate  boundary  and 
feasibility  conditions,  such  as  those  imposed  by  the  physical  limitations  of  the  UAVs. 
The  problem  of  generation  of  feasible  collision- free  trajectories  for  multiple  cooperative 
autonomous  vehicles  is  described  in  detail  in  [43]. 

A.  Path  Following  for  a  Single  UAV 

Pioneering  work  in  the  area  of  path  following  can  be  found  in  [44],  where  an  elegant 
solution  to  the  problem  was  presented  for  a  wheeled  robot  at  the  kinematic  level.  In  [44], 
the  kinematic  model  of  the  vehicle  was  derived  with  respect  to  a  Frenet-Serret  frame 
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moving  along  the  path,  while  playing  the  role  of  a  virtual  target  vehicle  to  be  tracked  by 
the  real  vehicle.  The  origin  of  the  Frenet-Serret  was  placed  at  the  point  on  the  path  closest 
to  the  real  vehicle.  This  work  led  to  a  great  deal  of  activity  in  the  literature  addressing 
the  path-following  control  problem.  Of  particular  interest  is  the  work  reported  in  [45],  in 
which  the  authors  reformulated  the  setup  used  in  [44]  and  derived  a  feedback  control  law 
that  steers  the  dynamic  model  of  a  wheeled  robot  along  a  desired  path  and  overcomes 
stringent  initial  condition  constraints  present  in  [44].  The  key  to  the  algorithm  in  [45] 
is  to  explicitly  control  the  rate  of  progression  of  the  virtual  target  along  the  path.  This 
effectively  creates  an  extra  degree  of  freedom  that  can  be  exploited  to  avoid  singularities 
that  occur  when  the  distance  to  the  path  is  not  well  defined. 

The  solution  to  the  path-following  problem  described  in  the  present  paper  extends 
the  algorithm  presented  in  [45]  to  the  3D  case,  and  relies  on  the  insight  that  a  UAV  can 
follow  a  given  path  using  only  its  attitude,  thus  leaving  its  linear  speed  as  an  extra  degree 
of  freedom  to  be  used  at  the  coordination  level.  The  key  idea  behind  the  algorithm  is  to 
use  the  vehicle’s  attitude  control  effectors  to  follow  a  virtual  target  vehicle  running  along 
the  path.  To  this  effect,  following  the  approach  developed  in  [45],  this  section  introduces 
a  frame  attached  to  this  virtual  target  and  defines  a  generalized  error  vector  between 
this  moving  coordinate  system  and  a  frame  attached  to  the  actual  vehicle.  With  this 
setup,  the  path-following  control  problem  is  reduced  to  that  of  driving  this  generalized 
error  vector  to  zero  by  using  only  the  UAV’s  attitude  control  effectors,  while  following  an 
arbitrary  feasible  speed  profile.  Next,  the  dynamics  of  the  kinematic  errors  between  the 
ith  vehicle  and  its  virtual  target  are  described. 


Figure  1:  Following  a  virtual  target  vehicle.  Problem  geometry. 

Figure  1  captures  the  geometry  of  the  problem  at  hand.  Let  pd(-)  be  the  desired  path 
assigned  to  one  of  the  UAVs,  and  let  if  be  its  total  length.  Let  I  denote  an  inertial 
reference  frame  {eu ,  ej2,  e/3},  and  let  Pi(t)  be  the  position  of  the  center  of  mass  Q  of 
the  UAV  in  this  inertial  frame.  Further,  let  P  be  an  arbitrary  point  on  the  desired  path 
that  plays  the  role  of  the  virtual  target,  and  let  pd(i)  denote  its  position  in  the  inertial 
frame.  Here  i  G  [0 ,if]  is  a  free  length- variable  that  defines  the  position  of  the  virtual 
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target  vehicle  along  the  path.  In  the  setup  adopted,  the  total  rate  of  progression  of  the 
virtual  target  along  the  path  is  an  extra  design  parameter.  Endowing  point  P  with  an 
extra  degree  of  freedom  is  the  key  to  the  path-following  algorithm  presented  in  [45]  and 
its  extension  to  the  3D  case  described  in  this  paper. 

For  our  purposes,  it  is  convenient  to  define  a  parallel  transport  frame  T  [46, 47]  at¬ 
tached  to  point  P  on  the  path  and  characterized  by  vectors  {t(£) ,  fii(£) ,  n2(£)}  ■  Vectors 
{t,  ni,n2}  define  an  orthonormal  basis  for  J7,  in  which  the  unit  vector  t{£)  defines  the 
tangent  direction  to  the  path  at  the  point  determined  by  £,  while  n\{£)  and  n2{£)  de¬ 
fine  the  normal  plane  perpendicular  to  t(£).  Unlike  the  Frenet-Serret  frame,  this  moving 
frame  is  well  defined  when  the  path  has  a  vanishing  second  derivative.  Moreover,  let 
Pf(1)  be  the  position  of  the  vehicle’s  center  of  mass  Q  in  the  parallel  transport  frame, 
and  let  xp(i),  jp/t),  and  zp(i)  be  the  components  of  the  vector  pp(t)  with  respect  to  the 
basis  {t,  n\ ,  n2}. 

Let  W  denote  a  vehicle-carried  velocity  frame  {wi,  w2 ,  w3}  with  its  origin  at  the  UAV 
center  of  mass  and  its  x-axis  aligned  with  the  velocity  vector  of  the  UAV.  The  2-axis 
is  chosen  to  he  in  the  plane  of  symmetry  of  the  UAV,  and  the  y- axis  is  determined  by 
completing  the  right-hand  system.  In  this  paper,  q(t)  and  r(t)  are  the  y-axis  and  2-axis 
components,  respectively,  of  the  vehicle’s  rotational  velocity  resolved  in  the  W  frame. 
With  a  slight  abuse  of  notation,  q(t)  and  r(t)  will  be  referred  to  as  pitch  rate  and  yaw 
rate ,  respectively,  in  the  W  frame. 

We  also  introduce  an  auxiliary  frame  V  {bw,  b2D,  b3p},  which  is  used  to  shape  the 
approach  attitude  to  the  path  as  a  function  of  the  cross-track  error  components  yp  and  zf- 
Frame  T>  has  its  origin  at  the  UAV  center  of  mass  and  the  vectors  bw{t),  and 

b3p(t)  are  defined  as 


dt  —  yFhi  —  Zpn2 
(d2  +  y\  +  z2fY 


ypt  +  dfii 


b3n  —  bin  x  b2D  ,  (1) 


with  d  being  a  (positive)  constant  characteristic  distance  that  plays  the  role  of  a  design 
parameter,  as  will  become  clear  later.  The  basis  vector  bw  (t)  defines  the  desired  direction 
of  the  UAV’s  velocity  vector.  Clearly,  when  the  vehicle  is  far  from  the  desired  path, 
vector  bw(t)  becomes  perpendicular  to  t(£).  As  the  vehicle  comes  closer  to  the  path  and 
the  cross-track  error  becomes  smaller,  then  bm(t)  tends  to  t(£). 

Finally,  let  R(t)  G  S0(3)  be  the  rotation  matrix  from  W  to  T>,  that  is, 


D  dD  _  tdJJ  t)F  _  (  r>r'\  I  p 

-ft  —  JO-w  ~  W  —  V-ft-D/  -ft 


W  5 


and  define  the  real-valued  error  function  on  SO(3) 


'i(K) 


(is  -  nJnR) 


(2) 


where  IIR  is  defined  as  II/j  =  [  [j  J  ?  ]  •  The  function  T  (R)  in  (2)  can  be  expressed  in  terms 
of  the  entries  of  R(t)  as  T (/?,)  =  ( 1/2) (1  —  Rn),  where  Ru(t)  denotes  the  (1,1)  entry 
of  R(t).  Therefore,  T(i?)  is  a  positive-definite  function  about  Rn  =  1.  Note  that  Rn  =  1 
corresponds  to  the  situation  where  the  velocity  vector  of  the  UAV  is  aligned  with  the  basis 
vector  bw(t),  which  defines  the  desired  attitude. 
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With  the  above  notation,  as  shown  in  [36],  the  path- following  kinematic-error  dynam¬ 
ics  between  the  UAV  and  its  virtual  target  vehicle  can  be  written  as 


pF\F  —  —  £t  -  UJF/I  X  pF  +  VWh 


V(R)  =  e 


R 


q 

r 


—  (Rf{ujf/i}f  +  {(^d/f}d)  )  , 


(3) 

(4) 


where  -]f  is  used  to  indicate  that  the  derivative  is  taken  in  the  parallel  transport  frame, 
v(t)  denotes  the  magnitude  of  the  UAV’s  ground  velocity  vector,  and  e^(t)  is  the  attitude 
kinematic  error  vector  defined  as 

4  Ur  ((i3  -  njn„)  ft  -  iiT  (i3  -  njn*))v , 


where  (-)v  :  so (3)  — >  M3  denotes  the  vee  map  (see  Appendix).  In  the  kinematic-error 
model  (3)-(4),  q{t )  and  r(t )  play  the  role  of  control  inputs,  while  the  rate  of  progres¬ 
sion  £{t)  of  point  P  along  the  path  becomes  an  extra  variable  that  can  be  manipulated 
at  will.  At  this  point,  the  path- following  generalized  error  vector  xpf(t )  can  be  formally 
defined  as 

r  i  T 


XPf 


Pf »  el 


Notice  that,  within  the  region  where  T(i?)  <  1,  if  xpf  =  0,  then  both  the  path- following 
position  error  and  the  path-following  attitude  error  are  equal  to  zero,  that  is,  pF  =  0  and 

R\ i  =  0. 

Using  the  above  formulation,  and  given  a  spatially  defined  feasible  path  Pd(-),  the 
problem  of  path  following  for  a  single  vehicle  can  now  be  defined  accodingly. 


Definition  1  (Path-Following  Problem)  For  a  given  UAV  (equipped  with  an  autopi¬ 
lot),  design  feedback  control  laws  for  pitch  rate  q(t),  yaw  rate  r(t),  and  rate  of  progres¬ 
sion  £(t)  of  the  virtual  target  along  the  path  such  that  all  closed-loop  signals  are  bounded 
and  the  path-following  generalized  error  vector  xpf(t )  converges  to  a  neighborhood  of  the 
origin  with  a  guaranteed  rate  of  convergence,  regardless  of  what  the  temporal  speed  as¬ 
signment  of  the  mission  is  (as  long  as  it  is  physically  feasible). 

Stated  in  simple  terms,  the  problem  above  amounts  to  designing  feedback  laws  so 
that  a  UAV  converges  to  and  remains  inside  a  tube  centered  on  the  desired  path  curve 
assigned  to  this  UAV,  for  an  arbitrary  speed  profile  (subject  to  feasibility  constraints). 


B.  Time-Critical  Coordination  and  Network  Model 

To  enforce  the  temporal  constraints  that  must  be  met  in  real  time  to  coordinate  the 
entire  fleet  of  vehicles,  the  speed  profile  of  each  vehicle  is  adjusted  based  on  coordination 
information  exchanged  among  the  UAVs  over  a  time- varying  communications  network.  To 
solve  this  coordination  problem,  we  first  formulate  it  as  a  consensus  problem ,  in  which  the 
objective  of  the  fleet  of  vehicles  is  to  reach  an  agreement  on  some  distributed  variables  of 
interest.  Hence,  an  appropriate  coordination  variable  needs  to  be  defined  for  each  vehicle 
that  captures  the  objective  of  the  cooperative  mission;  in  our  case,  simultaneous  arrival 
of  all  the  UAVs  at  their  final  destinations. 
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For  this  purpose,  let  £di(td)  be  defined  as  the  desired  normalized  curvilinear  abscissa 
of  the  fill  UAV  along  its  corresponding  path  at  the  desired  mission  time  td,  which  is  given 
by 

td 

^dfid)  -  J  vd,i(T)  dr  , 

with  £fi  and  vdd(-)  being,  respectively,  the  length  of  the  path  and  the  desired  speed  profile 
corresponding  to  the  fih  UAV.  The  trajectory-generation  algorithm  ensures  that  the 
desired  speed  profiles  vdd{-)  satisfy  feasibility  conditions,  which  implies  that  the  following 
bounds  hold  for  all  vehicles: 


0  finin  5;  ^max  ■  i  1,  .  .  .  ,  U  , 


(5) 


where  umin  and  wmax  denote,  respectively,  the  minimum  and  maximum  operating  speeds 
of  the  UAVs  involved  in  the  cooperative  mission.  From  the  definition  of  £'d  t(td)  and 
the  bounds  in  (5),  it  follows  that  £'di(td )  is  a  strictly  increasing  continuous  function  of  td 
mapping  [0,  td]  onto  [0, 1],  and  satisfying  £di(0)  =  0  and  £dji(td)  =  1.  Let  r/,;  :  [0, 1]  — >  [0,  td] 
be  the  inverse  function  of  £'di(td),  td  £  [0,  t^].  Clearly,  77^ (-)  is  also  a  strictly  increasing 
continuous  function  of  its  argument.  Then,  letting  £[{t)  be  the  normalized  curvilinear 
abscissa  at  time  t  of  the  fih  virtual  target  vehicle  running  along  its  path,  defined  as 


m  = 


m 

tfi  ’ 


where  &i(t)  £  [0 ,£fi]  was  introduced  in  the  previous  section,  define  the  time- variables 


i  —  1, . . . ,  n . 


From  this  definition,  it  follows  that  £(i)  £  [0,t^],  and  therefore  this  variable  can  be  seen 
as  a  virtual  time  that  characterizes  the  status  of  the  mission  for  the  fih  UAV  at  time  t 
in  terms  of  the  desired  mission  time  td. 

Note  that,  for  any  two  vehicles  i  and  j,  if  £*(t)  =  £j(t)  —  t'd  at  a  given  time  t,  then 
£'(f)  =  £di(t£d)  and  ££(t)  =  £dtj{td),  which  implies  that  at  time  t  the  target  vehicles  corre¬ 
sponding  to  UAVs  i  and  j  have  the  desired  relative  position  along  the  path  at  the  desired 
mission  time  t'd.  Clearly,  if  ^(t)  =  £j(t)  for  all  t  >  0,  then  the  fih  and  jth  virtual  target 
vehicles  maintain  desired  relative  position  along  the  path  at  all  times  and,  in  particu¬ 
lar,  these  two  target  vehicles  arrive  at  their  final  destinations  at  the  same  time,  which 
does  not  necessarily  correspond  to  the  desired  mission  duration  t*d.  Also,  in  the  case  of 
collision  avoidance  in  time  (see  [43]),  if  £j(i)  =  £j(t)  for  all  t  >  0,  then  the  solution  to 
the  trajectory-generation  problem  ensures  that  the  virtual  targets  i  and  j  do  not  collide. 
Moreover,  if  the  fih  virtual  target  travels  at  the  desired  speed  for  all  time  in  the  inter¬ 
val  [0,t],  that  is,  £i(r)  =  vd)i{r)  for  all  r  e  [0, t] ,  then  one  has  that  £i{r)  =  £dd(r)  for  all 
r  G  [0,t],  which  implies  that  £i(r)  =  r  (or  equivalently,  that  £i(r)  =  1)  for  all  r  £  [0 ,  t] . 
This  set  of  properties  makes  the  variables  £*(f)  an  appropriate  metric  for  vehicle  coordi¬ 
nation,  and  therefore  they  will  be  referred  to  as  coordination  states.  Notice  that  the  use 
of  these  specific  coordination  variables  is  motivated  by  the  work  in  [40]. 

To  meet  the  desired  temporal  assignments  of  the  cooperative  mission,  coordination 
information  is  to  be  exchanged  among  the  UAVs  over  the  supporting  communications 
network.  Next,  tools  and  facts  from  algebraic  graph  theory  are  used  to  model  the  infor¬ 
mation  exchange  over  the  time- varying  network  as  well  as  the  constraints  imposed  by  the 
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communications  topology  (see,  for  example,  [7],  [48]  and  references  therein).  The  reader 
is  also  referred  to  [49]  for  key  concepts  and  details  on  algebraic  graph  theory. 

First,  in  order  to  account  for  the  communications  constraints  imposed  by  this  inter¬ 
vehicle  network,  it  is  assumed  that  the  ith  UAV  can  only  exchange  information  with  a 
neighboring  set  of  vehicles,  denoted  here  by  A/).  It  is  also  assumed  that  the  communication 
between  two  UAVs  is  bidirectional  and  that  the  information  is  transmitted  continuously 
with  no  delays.  Moreover,  since  the  flow  of  information  among  vehicles  may  be  severely 
restricted,  either  for  security  reasons  or  because  of  tight  bandwidth  limitations,  each 
vehicle  is  only  allowed  to  exchange  its  coordination  state  £j(£)  with  its  neighbors.  Finally, 
it  is  assumed  that  the  connectivity  of  the  communications  graph  T(t)  that  captures  the 
underlying  bidirectional  communications  network  topology  of  the  fleet  at  time  t  satisfies 
the  persistency  of  excitation  (PE)-like  condition 


t+T 

I  QL{t)  QTdr  >  nln-i,  for  all  t  >  0  , 

t 


(6) 


where  L(t)  G  Mnxn  is  the  Laplacian  of  the  graph  T (t),  and  Q  is  an  (n  —  1)  x  n  matrix 
such  that  Qln  =  0  and  QQT  =  In_i,  with  ln  being  the  vector  in  Rn  whose  components 
are  all  1.  The  parameters  T,/i  >  0  characterize  the  quality  of  service  (QoS)  of  the 
communications  network,  which  in  the  context  of  this  paper  represents  a  measure  of  the 
level  of  connectivity  of  the  communications  graph.  Note  that  the  PE-like  condition  (6) 
requires  only  the  communications  graph  F(t)  to  be  connected  in  an  integral  sense,  not 
pointwise  in  time.  In  fact,  the  graph  may  be  disconnected  during  some  interval  of  time 
or  may  even  fail  to  be  connected  for  the  entire  duration  of  the  mission.  Similar  types  of 
conditions  can  be  found,  for  example,  in  [50]  and  [4], 

Using  the  formulation  above,  one  can  now  define  the  problem  of  time-critical  cooper¬ 
ative  path  following  for  a  fleet  of  n  UAVs. 


Definition  2  (Time-Critical  Cooperative  Path-Following  Problem)  Given  a  fleet 
of  n  vehicles  supported  by  an  inter-vehicle  communications  network  and  a  set  of  desired 
3D  time  trajectories  Pd,iifd) ,  design  feedback  control  laws  for  pitch  rate  q{t),  yaw  rate  r(t), 
and  speed  v(t)  for  all  vehicles  such  that 

1.  all  closed-loop  signals  remain  bounded; 

2.  for  each  vehicle  i,  i  G  {1, . . . ,  n},  the  path-following  generalized  error  vector  xpfflt) 
converges  to  a  neighborhood  of  the  origin;  and 

3.  for  each  pair  of  vehicles  i  andj,  i,j  G  {1 . . .  ,n},  the  coordination  error  |£j(i)  —  Q(f)| 
converges  to  a  neighborhood  of  the  origin,  guaranteeing  (quasi-) simultaneous  time 
of  arrival  and  ensuring  collision-free  maneuvers. 


III.  3D  Path  Following  Control  law 

To  solve  the  path-following  problem  described  in  Section  II. A,  we  first  let  the  rate  of 
progression  of  point  P  along  the  path  be  governed  by 


£  =  v  u>i  ■  t  +  K^Pf  ■  t , 


(7) 
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where  K £  is  a  positive  constant  gain.  Then,  the  rate  commands  qc{t)  and  rc(t)  given  by 


Qc 

rc 


—  n rRt  ( Rf{uf/i}f  +  {^d/f}d) 


ReR  > 


(8) 


where  K ^  is  also  a  positive  gain,  drive  the  path-following  generalized  error  vector  xpf(t ) 
to  a  neighborhood  of  zero  with  a  guaranteed  rate  of  convergence.  More  precisely,  it  can  be 
shown  that  if  the  speed  of  the  vehicle  satisfies  0  <  wmin  <  v(t)  <  nmax,  then  the  origin  of 
the  kinematic  error  equations  in  (3)-(4)  with  the  controllers  qc(t)  and  rc(t)  dehned  in  (8) 
is  locally  exponentially  stable.  A  formal  statement  of  this  result  can  be  found  in  [36]. 

We  notice  that  the  dynamics  of  the  virtual  target  along  the  path  depend  on  both  the 
ground  velocity  vector  of  the  UAV,  vw\,  and  the  path-following  position-error  vector,  pp\ 
in  fact,  the  first  term  in  (7)  represents  the  projection  of  the  vehicle  ground  velocity  vector 
onto  the  tangent  direction  to  the  path  t,  while  the  second  term  corresponds  to  a  correction 
related  to  the  path- following  along-track  error  xp.  Similarly,  the  rate  commands  in  (8) 
also  allow  for  an  intuitive  interpretation:  the  first  term  represents  a  feed-forward  control 
signal  that  accounts  for  the  angular  velocity  of  frame  T  with  respect  to  Z;  the  second 
term  is  responsible  for  shaping  the  approach  attitude  to  the  path  as  a  function  of  the 
cross-track  error;  finally,  the  third  term  corresponds  to  a  correction  related  to  the  path¬ 
following  attitude-error  e^. 

We  also  notice  that  the  use  of  the  Special  Orthogonal  group  S0(3)  in  the  formulation 
of  the  attitude  control  problem  avoids  the  geometric  singularities  and  complexities  that 
appear  when  dealing  with  local  parameterizations  of  the  vehicle’s  attitude.  See,  for 
example,  the  path-following  control  algorithm  reported  in  [42], 

Finally,  we  note  that  the  choice  of  the  characteristic  distance  d  in  the  definition  of 
the  auxiliary  frame  V  (see  (1))  can  be  used  to  adjust  the  rate  of  convergence  of  the  path¬ 
following  closed-loop  system.  This  is  consistent  with  the  fact  that  a  large  parameter  d 
reduces  the  penalty  for  cross-track  position  errors,  which  results  in  a  slow  rate  of  con¬ 
vergence  of  the  UAV  to  the  path.  On  the  other  hand,  small  values  of  d  allow  for  higher 
rates  of  convergence,  which  however  might  result  in  oscillatory  path-following  behavior. 
Figure  2  illustrates  this  point. 


d  ~  oo  d  large  d  small 


(a)  no  convergence  (b)  slow  convergence  (c)  fast  convergence 


Figure  2:  Effect  of  the  characteristic  distance  d  on  the  convergence  of  the  vehicle  to  the 
path.  In  these  plots,  the  blue  line  is  the  desired  path,  the  green  line  represents  the  desired 
approach  curve,  and  the  red  line  corresponds  to  the  resulting  vehicle  trajectory. 
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Finally,  we  notice  that  the  solution  to  the  path-following  problem  for  the  ith  vehicle 
presented  above  is  independent  of  the  desired  speed  profile  Vd,i(-),  and  uses  only  local 
measurements  for  feedback.  The  path- following  control  laws  qc{t)  and  rc(t)  represent 
outer-loop  guidance  commands  that  are  to  be  tracked  by  the  UAV  to  ensure  safety  and 
success  of  the  cooperative  mission.  In  this  sense,  this  solution  for  path-following  control 
departs  from  standard  backstepping  techniques  in  that  the  final  path-following  control 
law  makes  explicit  use  of  the  existing  autopilot  and  retains  its  stabilizing  properties  and 
tracking  capabilities. 


IV.  Time-Critical  Coordination 

The  previous  section  presented  a  solution  to  the  path- following  problem  for  a  single 
UAV  and  an  arbitrary  feasible  speed  profile  by  using  a  control  strategy  in  which  the 
vehicle’s  attitude  control  effectors  are  used  to  follow  a  virtual  target  running  along  the 
path.  We  now  address  the  problem  of  time-critical  cooperative  path-following  control  of 
multiple  vehicles.  To  this  effect,  the  speeds  of  the  UAVs  are  adjusted  based  on  coordi¬ 
nation  information  exchanged  among  the  vehicles  over  the  supporting  communications 
network.  In  particular,  the  outer-loop  coordination  control  law  is  intended  to  provide  a 
correction  to  the  desired  speed  profile  Vd,i(-)  obtained  in  the  trajectory-generation  step, 
and  to  generate  a  total  speed  command  vCii(t).  This  speed  command  is  then  to  be  tracked 
by  the  ith  vehicle  to  achieve  coordination  in  time. 


A.  Distributed  Coordination  Law 

We  start  by  noting  that  the  evolution  of  the  ith  coordination  state  is  given  by  [36] 


i(t)  = 


Recalling  from  the  solution  to  the  path-following  problem  that  the  evolution  of  the  ith  vir¬ 
tual  target  vehicle  along  the  path  is  described  by 

h  =  (viWij  +  KepF'i)  ■ ti , 


where  for  simplicity  we  keep  K(  without  indexing  and  drop  the  dependency  of  the  various 
variables  on  t,  the  dynamics  of  the  ith  coordination  state  can  be  rewritten  as 

^  _  (viW^i  +  KepF,i)  ■  U 

*  VdMd 

Then,  to  solve  the  time-coordination  problem  we  use  dynamic  inversion  and  define  the 
speed  command  for  the  ith  vehicle  as 


^coord A lPF,i  '  ti 
^l,i  '  ti 


(10) 


where  Wcoord,i(£)  is  a  coordination  control  law  to  be  defined  later.  With  this  speed  com¬ 
mand,  the  coordination  dynamics  for  the  ith  target  vehicle  can  be  rewritten  as 


where  e„,;(t)  =  Vi(t )  —  vc^(i)  denotes  the  speed  tracking  error  for  the  zth  UAV. 

Recall  now  that  each  UAV  is  allowed  to  exchange  only  its  coordination  parameter  £*(t) 
with  its  neighbors  A /),  which  are  defined  by  the  time- varying  communications  topology. 
To  observe  this  constraint,  the  following  distributed  coordination  law  is  proposed: 

^coord,l(^)  ^  (£l(f)  £j(^))  T  1  , 

j'eA/i 

^coord ,i{t)  Q  ^  ^  (£i(^)  0(^))  A  Xl,i(t)  i  ^  2,  .  .  .  ,  71  , 

j&Mi 

Xi,i(t)  =  -&(*))>  xi,i( o)  =  1 ,  i  =  2,...,n, 

jeATi 

where  vehicle  1  is  elected  as  the  formation  leader  (which  can  be  a  virtual  vehicle),  and 
a  and  b  are  positive  adjustable  coordination  control  gains.  Note  that  the  coordination 
control  law  has  a  proportional-integral  structure,  which  provides  disturbance  rejection 
capabilities  at  the  coordination  level.  Moreover,  note  that  the  vehicles  exchange  infor¬ 
mation  only  about  the  corresponding  virtual  targets,  rather  than  exchanging  their  own 
state  information.  Finally,  we  notice  that  protocol  (11)  can  be  easily  modified  to  include 
multiple  leaders,  which  improves  robustness  of  the  control  architecture  to  a  single-point 
failure;  see  [51]. 

B.  Overall  Time-Critical  Cooperative  Path- Following  System 

Figure  3  shows  the  complete  time-critical  cooperative  path-following  closed-loop  control 
architecture  for  the  ith  vehicle,  including  the  nonlinear  path-following  algorithm  and  the 
distributed  coordination  control  law.  With  this  approach,  the  overall  cooperative  control 
architecture  presented  in  this  article  exhibits  a  multiloop  control  structure  in  which  an 
inner-loop  controller  stabilizes  the  vehicle  dynamics,  while  guidance  outer-loop  controllers 
are  designed  to  control  the  vehicle  kinematics,  providing  path-following  and  time-critical 
cooperative  capabilities. 


(Ha) 

(lib) 

(11c) 


Figure  3:  Coordinated  path-following  closed-loop  for  the  ith  vehicle. 
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It  is  proven  in  [36]  that,  if  the  connectivity  of  the  communications  graph  verifies  the 
PE-like  condition  (6)  and  the  initial  conditions  are  within  a  given  domain  of  attrac¬ 
tion,  then  there  exist  control  gains  for  the  path-following  control  law  (7)- (8)  and  the 
coordination  control  law  (10)-(11)  that  ensure,  first,  that  the  path- following  generalized 
error  vector  xpfp(t)  of  each  vehicle  converges  exponentially  fast  to  a  neighborhood  of 
zero;  second,  that  for  each  pair  of  vehicles  i  and  j,  i,j  G  {1 . . .  ,n},  the  coordination  er¬ 
ror  | £j(i)  —  £j(t)\  also  converges  to  a  neighborhood  of  zero  exponentially  fast;  and  third, 
that  the  speed  of  each  UAV  satisfies  nm;n  <  Vi(t)  <  vmax  for  all  t  >  0. 

Additionally,  it  is  shown  in  [36]  that  the  QoS  of  the  network,  characterized  by  the 
parameters  T  and  /i,  limits  the  achievable  guaranteed  rate  of  convergence  for  the  coor¬ 
dination  control  loop.  The  results  in  this  paper  also  imply  that,  as  the  parameter  T 
goes  to  zero  and  the  communications  graph  becomes  thus  connected  pointwise  in  time, 
the  convergence  rate  of  the  coordination-error  dynamics  can  be  set  arbitrarily  fast  by 
increasing  the  coordination  control  gains.  This  fact  is  consistent  with  results  obtained  in 
previous  work  on  time-critical  cooperative  path- following  control;  see  [39,  Lemma  2], 

Finally,  we  notice  that  similar  results  have  been  derived  for  the  case  of  a  coordination 
protocol  with  multiple  leaders  [51];  in  this  case,  the  convergence  rate  of  the  coordination 
dynamics  depends  not  only  on  the  QoS  of  the  network,  but  also  on  the  number  of  leaders. 
The  work  reported  in  [51]  also  analyzes  the  convergence  properties  of  protocol  (11)  when 
the  vehicles  exchange  quantized  measurements,  and  proves  the  existence  of  undesirable 
“zero-speed”  attractors  in  the  presence  of  coarse  quantization. 

V.  Simulation  Results 

This  section  presents  simulation  results  of  two  cooperative  multi-vehicle  mission  sce¬ 
narios  that  show  the  efficacy  of  the  cooperative  framework  in  this  paper.  In  the  first 
mission,  three  UAVs  must  execute  a  coordinated  maneuver  to  arrive  at  predefined  posi¬ 
tions  at  the  same  time.  We  then  consider  a  second  mission  in  which  three  UAVs  must 
execute  sequential  auto-landing  while  maintaining  a  prespecified  safe-guarding  separation 
along  the  glideslope.  Both  missions  are  designed  to  be  executed  by  small  tactical  UAVs 
equipped  with  an  autopilot  providing  angular-rate  and  speed  tracking  capabilities;  see 
Figure  4. 


Figure  4:  SIG  Rascal  110  research  aircraft  operated  by  the  Naval  Postgraduate  School  for 
time-critical  cooperative  missions.  Onboard  avionics  include  the  Piccolo  Plus  autopilot, 
two  PC-104  industrial  embedded  computers,  and  a  wireless  MANET  link  for  air-to-air 
and  air-to-ground  communications. 
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A.  Path-Following  with  Simultaneous  Arrival 


In  this  mission  scenario,  three  UAVs  are  tasked  to  converge  to  and  follow  three  spatially- 
deconflicted  paths  and  arrive  at  their  final  destinations  at  the  same  time.  A  representative 
example  of  such  missions  is  simultaneous  suppression  of  multiple  targets  located  at  dif¬ 
ferent  positions.  Note  that  this  mission  imposes  only  relative  (rather  than  absolute ) 
temporal  constraints  on  the  arrival  of  the  UAVs. 

Figure  5  shows  the  three  paths  with  the  parallel  transport  frames  as  well  as  the 
corresponding  desired  speed  profiles,  which  assume  a  final  desired  speed  of  20  —  for  all 
UAVs.  The  beginning  of  each  path  is  indicated  in  this  figure  with  a  circle.  The  figure  also 
shows  the  coordination  maps  77,  relating  the  desired  normalized  curvilinear  abscissa  £'di 
to  the  desired  mission  time  td .  The  paths  have  lengths  lf\  =  2,  084.8  m,  if2  =  1,  806.4  m, 
and  If?,  =  2,  221.0  m,  and  the  desired  time  of  arrival  is  t*d  =  85.0  s.  The  arrival  margin8,  for 
these  trajectories  is  approximately  31.0  s.  Figure  6  presents  the  path  separations,  which 
show  a  minimum  spatial  clearance  of  125  m,  and  the  desired  inter-vehicle  separations  for 
this  particular  mission. 

The  cooperative  motion-control  algorithms  described  in  this  paper  are  used  to  solve 
this  multi-vehicle  simultaneous  arrival  path-following  problem.  In  order  to  achieve  coor¬ 
dination,  the  UAVs  rely  on  a  supporting  communications  network.  The  information  flow 
is  assumed  to  be  time-varying  and,  at  any  given  time  t ,  is  characterized  by  one  of  the 
graphs  in  Figure  7. 

Simulation  results  for  this  particular  mission  are  presented  next.  Figure  8  illustrates 
the  evolution  of  the  UAVs  (blue)  as  well  as  the  virtual  targets  (red)  moving  along  the 
paths  (green).  This  figure  also  includes  the  W  frame  attached  to  each  UAV  (blue)  as 
well  as  the  T  frame  attached  to  the  virtual  targets  (gray).  The  UAVs  start  the  mission 
with  an  initial  offset  in  both  position  and  attitude  with  respect  to  the  beginning  of  the 
framed  paths.  As  can  be  seen  in  the  figure,  the  path-following  algorithm  is  able  to 
eliminate  this  initial  offset  and  steer  the  UAVs  along  the  corresponding  paths,  while  the 
coordination  algorithm  ensures  simultaneous  arrival  at  the  end  of  the  path  at  t  =  83.4  s. 
Details  about  the  performance  of  the  path-following  algorithm  are  shown  in  Figure  9;  the 
path-following  position  and  attitude  errors,  ppd  and  T(iU),  converge  to  a  neighborhood 
of  zero  within  30  s.  The  figure  also  presents  the  angular-rate  commands,  qcd  and  rCd,  as 
well  as  the  rate  of  progression  of  the  virtual  targets  along  the  path  £t.  The  evolution  of 
the  coordination  errors  £$  —  0  and  the  rate  of  change  of  the  coordination  states  £*  are 
illustrated  in  Figure  10,  along  with  the  resulting  UAV  speeds  and  the  integral  states  of  the 
PI  protocol  implemented  on  the  follower  vehicles.  The  figure  shows  that  the  coordination 
errors  converge  to  a  neighborhood  of  zero,  while  the  rate  of  change  of  the  coordination 
states  converges  to  the  desired  rate  £ref  =  1.  In  particular,  Figure  10b  illustrates  how 
the  vehicles  adjust  their  speeds  (with  respect  to  the  desired  speed  profile)  to  achieve 
coordination.  Finally,  Figure  11  shows  an  estimate  of  the  QoS  of  the  network,  computed 
as 

/  t  \ 


pit)  •  V 


Q3L(t)Qz  dr 


t  >  T, 


(12) 


with  T  =  5  sec. 


a Arrival  margin  is  a  measure  of  robustness  of  the  generated  trajectories  at  the  coordination  level; 
see  [43]. 
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(b)  Desired  speed  profiles  (c)  Coordination  maps 

Figure  5:  Path-Following  with  Simultaneous  Arrival.  Framed  3D  spatial  paths  along  with 
the  corresponding  desired  speed  profiles  and  coordination  maps. 
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(a)  Separation  between  paths  1  and  2 


(b)  Separation  between  paths  1  and  3 


(c)  Separation  between  paths  2  and  3  (d)  Desired  inter-vehicle  separation 

Figure  6:  Path-Following  with  Simultaneous  Arrival.  Path  separation  and  desired  inter- 
vehicle  separation;  the  three  paths  are  spatially  deconflicted  with  a  minimum  clearance 
of  125  m. 
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(a)  Topology  1 

(b)  Topology  2 

(c)  Topology  3 

(d)  Topology  4 

Figure  7:  Network  topologies.  At  any  given  time  t,  the  dynamic  information  flow  is 
characterized  by  one  of  these  graphs. 
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Altitude  [m]  Altitude  [m]  Altitude  [m] 


Figure  8:  Path-Following  with  Simultaneous  Arrival.  The  three  UAVs  achieve  simulta¬ 
neous  arrival  at  their  final  destinations  at  t  —  83.4  s. 
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(a)  Position  error 


(b)  Angular  rates 


(c)  Attitude  error 


(d)  Progression  of  the  virtual  targets 


Figure  9:  Path-Following  with  Simultaneous  Arrival.  The  path-following  algorithm  drives 
the  path-following  position  and  attitude  errors  to  a  neighborhood  of  zero. 
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(a)  Coordination  errors 


(c)  Coordination-state  rates 


(d)  Integral  states 


Figure  10:  Path-Following  with  Simultaneous  Arrival.  The  coordination  protocol  ensures 
that  the  coordination  errors  converge  to  a  neighborhood  of  zero  and  also  that  the  rate  of 
change  of  the  coordination  states  evolves  at  about  the  desired  rate  £ref  =  1. 
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Figure  11:  Path-Following  with  Simultaneous  Arrival.  The  graph  capturing  the  time- 
varying  information  flow  is  only  connected  in  an  integral  sense,  and  not  pointwise  in 
time. 
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B.  Sequential  Auto-landing 

Here,  three  UAVs  must  arrive  at  the  assigned  glideslope  separated  by  prespecified  safe¬ 
guarding  time-intervals,  and  then  follow  the  glide  path  at  a  constant  approach  speed 
while  maintaining  the  safe-guarding  separation.  To  this  end,  time-deconflicted  transition 
trajectories  are  generated  from  prespecified  initial  conditions  to  the  beginning  of  the  glide 
path,  satisfying  the  desired  inter-vehicle  arrival  schedule  and  taking  the  UAVs  to  the 
desired  approach  speed.  Again,  this  mission  imposes  only  relative  temporal  constraints 
on  the  arrival  of  the  UAVs. 

Figure  12  shows  the  three  transition  paths  with  the  parallel  transport  frames  as  well 
as  the  framed  3-deg  glide  path.  The  beginning  of  each  transition  path  is  indicated  with 
a  circle,  while  the  beginning  of  the  glide  path  is  indicated  with  a  triangle.  The  fig¬ 
ure  also  presents  the  desired  speed  profiles  for  the  initial  transition  phase  that  ensure 
a  desired  safe-guarding  arrival  separation  of  30  s,  trajectory  deconfliction,  as  well  as  a 
final  approach  speed  of  20  — .  The  transition  coordination  maps  are  shown  in  Figure  12c. 
Finally,  the  figure  also  includes  the  desired  speed  profile  for  the  approach  along  the  glides¬ 
lope  as  well  as  the  corresponding  coordination  map.  The  transition  paths  have  lengths 
£fi  =  1,609.0  m,  lf2  =  1,962.7  m,  and  Ifz  =  2,836.7  m,  and  the  desired  times  of  arrival 
at  the  glideslope  are  t*dl  =  65.0  s,  t*d2  =  95.0  s,  and  td3  =  125.0  s.  The  arrival  margin  for 
these  transition  trajectories  is  approximately  28.8  s.  Figure  13  presents  the  path  separa¬ 
tions,  which  show  that  the  three  transition  paths  meet  at  their  end  positions  (beginning 
of  the  glideslope),  whereas  the  desired  inter- vehicle  separations  for  this  particular  mission 
are  never  less  than  350  m. 

The  cooperative  motion-control  algorithms  described  in  this  paper  can  be  used  to  solve 
this  sequential  auto-landing  problem.  In  this  case,  however,  since  the  UAVs  are  required 
to  maintain  a  safe-guarding  separation  during  the  approach  along  the  glide  path,  the 
coordination  states  have  to  be  redefined  as  the  vehicles  reach  the  glideslope.  Hence, 
while  the  ?'th  UAV  is  flying  along  its  transition  path,  its  coordination  state  is  defined  as 

&(*)  =Vi(%(t)), 

where  £j(t)  is  the  normalized  curvilinear  abscissa  of  the  Ah  virtual  target  along  the 
corresponding  transition  path.  When  the  UAV  reaches  the  beginning  of  the  glide  path, 
then  its  coordination  state  is  (re) defined  as 

Ci(t)  =77gs  «W)  +  4> 

where  £[{t)  is  now  the  normalized  curvilinear  abscissa  of  the  Ah  virtual  target  along  the 
glide  path,  and  t*di  is  the  desired  time  of  arrival  of  the  Ah  UAV  at  the  glideslope. 

Next,  we  present  simulation  results  for  this  mission  scenario.  Figure  14  illustrates 
the  evolution  of  the  UAVs  (blue)  as  well  as  the  virtual  targets  (red)  moving  along  the 
paths  (green  and  light  blue).  Similar  to  the  previous  mission  scenario,  the  UAVs  start  the 
mission  with  an  initial  offset  in  both  position  and  attitude  with  respect  to  the  beginning 
of  the  transition  paths.  As  can  be  seen  in  the  figure,  the  path-following  algorithm  is 
able  to  eliminate  this  initial  offset  and  steer  the  UAVs  along  the  corresponding  transition 
paths,  while  the  coordination  algorithm  ensures  that  the  UAVs  reach  the  glideslope  sepa¬ 
rated  by  a  desired  time-interval.  The  UAVs  reach  the  glideslope  at  t  =  66.4  s,  t  =  96.2  s, 
and  t  =  126.2  s,  approximately  meeting  the  desired  30  s  inter-vehicle  separation.  After 
reaching  the  glideslope,  the  path-following  algorithm  ensures  that  the  UAVs  stay  on  the 
glide  path  as  the  coordination  algorithm  maintains  the  desired  safe-guarding  separation. 
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(a)  Framed  3D  paths 


(b)  Transition:  Desired  speed  profiles  (c)  Transition:  Coordination  maps 
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(d)  Glideslope:  Desired  speed  profile 


(e)  Glideslope:  Coordination  map 


Figure  12:  Sequential  Auto-landing.  Framed  3D  spatial  paths  along  with  the  correspond¬ 
ing  desired  speed  profiles  and  coordination  maps  for  both  the  transition  trajectories  and 
the  glideslope. 
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(a)  Separation  between  paths  1  and  2 


(b)  Separation  between  paths  1  and  3 


(c)  Separation  between  paths  2  and  3 


(d)  Desired  inter-vehicle  separation 


Figure  13:  Sequential  Auto-landing.  Path  separation  and  desired  inter-vehicle  separation 
during  the  transition  phase;  the  speed  profiles  ensure  deconfliction  of  the  three  desired 
trajectories  with  a  minimum  clearance  of  350  m. 


The  simulation  is  stopped  when  the  first  UAV  reaches  the  end  of  the  glide  path.  Fig¬ 
ure  15  shows  the  path-following  position  and  attitude  errors,  pp,i  and  T(ilj),  as  well 
as  the  angular-rate  commands,  qc ti  and  rCji,  and  the  rate  of  progression  of  the  virtual 
targets  along  the  path  The  path-following  errors  converge  to  a  neighborhood  of  zero 
within  40  s.  The  coordination  errors  £*  —  also  converge  to  a  neighborhood  of  zero,  while 
the  rate  of  change  of  the  coordination  states  £*  converges  to  neighborhood  of  the  desired 
rate  £ref  =  1;  see  Figure  16.  This  figure  also  shows  the  UAV  speeds  and  the  integral  states 
of  the  PI  protocol  implemented  on  the  follower  vehicles.  In  particular,  Figure  16b  shows 
that,  after  an  initial  transient  caused  by  the  initial  path-following  errors  as  well  as  the 
speed  corrections  introduced  by  the  coordination  protocol,  the  speed  of  each  UAV  con¬ 
verges  to  its  desired  speed  and,  as  the  vehicles  enter  the  glide  path,  their  speeds  converge 
to  the  desired  approach  speed  of  20  — .  Finally,  similar  to  the  previous  mission  scenario, 
Figure  17  shows  an  estimate  of  the  QoS  of  the  network,  computed  as  in  (12). 
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Figure  14:  Sequential  Auto-landing.  The  three  UAVs  arrive  at  the  beginning  of  the  glide 
path  separated  by  approximately  30  s  and  maintain  this  safe-guarding  separation  as  they 
fly  along  the  glideslope. 
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Figure  15:  Sequential  Auto-landing.  The  path-following  algorithm  drives  the  path¬ 
following  position  and  attitude  errors  to  a  neighborhood  of  zero. 
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(a)  Coordination  errors  (b)  UAV  speeds 


(c)  Coordination-state  rates  (d)  Integral  states 


Figure  16:  Sequential  Auto-landing.  The  coordination  protocol  ensures  that  the  coordi¬ 
nation  errors  converge  to  a  neighborhood  of  zero,  thus  ensuring  trajectory  deconfliction, 
and  also  that  the  rate  of  change  of  the  coordination  states  evolves  at  about  the  desired 
rate  £ref  =  1. 
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Figure  17:  Sequential  Auto-landing.  The  graph  capturing  the  time- varying  information 
flow  is  only  connected  in  an  integral  sense,  and  not  pointwise  in  time. 
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VI.  Conclusion 


The  paper  presented  simulation  results  of  two  multi- vehicle  time-critical  missions  that 
exploit  a  cooperative  control  framework  proposed  by  the  authors  in  [36].  The  simulation 
study  illustrated  the  efficacy  of  the  algorithms  developed  and  verified  the  main  theoretical 
claims.  In  particular,  the  results  demonstrated  that  (i)  at  the  local  level,  the  proposed 
path-following  control  law  ensures  that  every  UAV  converges  to  and  follows  its  own  path 
independently  of  the  temporal  assignments  of  the  mission;  and  ( ii )  at  the  coordination 
level,  the  distributed  protocol  enforces  the  temporal  constraints  by  adjusting  the  speed 
profile  of  each  vehicle  based  on  coordination  information  exchanged  over  the  supporting 
communications  network. 
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Appendix:  The  hat  and  vee  maps  [52] 

The  hat  map  (-)A  :  R3  — >  so(3)  is  defined  as 

0  —  23  X2 

X3  0  —XI 
—X2  XI  0  . 

for  x  =  [x\,  X2,  Xs]T  G  R3.  The  inverse  of  the  hat  map  is  referred  to  as  the  vee 
map  (-)v  :  so(3)  — >  R3.  The  reader  is  referred  to  [52]  for  further  details  on  the  hat  and 
vee  maps. 
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